Differentiable transient rendering

Rendering Relativistic Effects in Transient Imaging

We present a real-time framework which allows interactive visualization of relativistic effects for time-resolved light transport. We leverage data from two different sources: real-world data acquired with an effective exposure time of less than 2 picoseconds, using a novel imaging technique termed femto-photography, and a transient renderer based on ray-tracing. We overcome the two main limita...

Supplementary Material: A Framework for Transient Rendering

Differentiable Invariants

Invariants that incrementally maintain the value of expressions under assignments to their variables are a natural abstraction to build high-level local search algorithms. But their functionalities are not sufficient to allow arbitrary expressions as constraints or objective functions as in constraint programming. Differentiable invariants bridge this expressiveness gap. A differentiable invari...

Differentiable Imbeddings

1. Terminology. V and M will be differentiable manifolds of dimension n and m respectively; differentiable meaning always of class C. For simplicity, we assume V compact and without boundary. We shall have to consider several categories of maps: (1) the category of continuous maps, (2) the category of topological imbeddings, (3) the category of topological immersions: a map ƒ: F—>M is a topolog...

Differentiable Memory

We describe a new spatio-temporal video autoencoder, based on a classic spatial image autoencoder and a novel nested temporal autoencoder. The temporal encoder is represented by a differentiable visual memory composed of convolutional long short-term memory (LSTM) cells that integrate changes over time. Here we target motion changes and use as temporal decoder a robust optical flow prediction m...